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(57) The movement of an image component is de- 
termined using the plot information, such as the position, 
size of the image component, etc., at each time. The. 
complex movement of each image component can be 



easily generated by providing a plurality of plot informa- 
tion generating units for each image component and 
combining a plurality of pieces of plot information gen- 
erated by the plot information generating units when an 
image is reproduced. 



< 

00 

O 
CM 



Q. 

LU 



11 



1MAQETT 




65J 
41 



-64 



COORDINATES *1, yl[ 



PLOT INFORMATION GENERATING UNIT it S 



PLOT INFORMATION FUNCTION pfl 



PLOT INFORMATION GENERATING UNfT #2 



4 X* PUyr INFORMATION FUNCTION pf2 



1 1« 



IMAGE 12 




fS j COORDINATES x2, yT| 



PLOT INFORMATION GENERATING UNIT 



PLOT INFORMATION FUNCTION pf 2 



41 



1 1 



FIG. 21 



PLOT ' INFORMATION FUNCTION pfl 



VERTICAL VIBRATION 
lz-0 



A 
V 



■52 



nRlGHTW 
Jy-0 



IMAGE 13 


65- 
f* 4T 




Logo 
Image 


COORDINATES *3 f y3 | 


PLOT INFORMATION GENERATING UNIT *j 


PLOT INFORMATION STRING 101 I 







PLOT INFORMATION FUNCTION pf 2 
RIGHTWARD SHIFT 



52 



SHIFT ALONG A SQUARE 

<Jx AND dy ARE LINEARLY 
INTERPOLATED USING THE 
FOLLOWING TABLE 



PLOT INFO RMATION STRING ID* 



TIME 


X 


Y 


-JL 


ft 


P 


-1 


-isa.. 


ft... 


2 


1M 


JO. 


a 


0 . 


JW 




0 . 





•32 



Printed by Jouve, 75001 PARIS (FR) 



BNSDOCID: <EP 



1120748A1_I_> 



1 

Description 

Technical Field 

[0001] The present invention relates to a dynamic im- 
age composition apparatus for combining one or more 
dynamic images and displaying them on a screen and 
a method thereof. 

Background Art 

[0002] Recently, with the spread of personal comput- 
ers and workstations, the number of users who use the 
reproduction software of dynamic image data to repro- 
duce an image while moving the image on a screen has 
been increasing. Conventional reproduction software 
has a function to combine and store both the data of an 
image component to be displayed and the data of the 
movement and to transmit the combined data to a plot- 
ting device when the image is reproduced. 
[0003] However, when a complex movement, such as 
when an image component moves while vertically vi- 
brating, is reproduced, a last movement must be man- 
ually composed in advance. Therefore, to represent a 
plurality of different complex movements when an im- 
age is reproduced, all kinds of movements are com- 
posed in advance and each image component is dis- 
played according to a respective predetermined move- 
ment when the image is reproduced. Even when a plu- 
rality of image components are composed of the same 
movement element, such as translation, etc., each 
movement must be individually composed. 
[0004] As described above, in the conventional repro- 
duction software, a great amount of movement data 
must be prepared to represent many complex move- 
ments. A new movement cannot also be composed 
when an image is reproduced, norcan a movement also 
be flexibly modified. Furthermore, the conventional re- 
production software has a problem that there is no meth- 
od for sharing the same movement element with a plu- 
rality of image components. 

Disclosure of Invention 

[0005] It is an object of the present invention to pro- 
vide a dynamic image composition apparatus for im- 
proving the versatility of each movement element and 
for easily representing a complex movement when dis- 
playing a plurality of dynamic images on a screen and 
a method thereof. 

[0006] Fig. 1 shows the basic configuration of the dy- 
namic image composition apparatus of the present in- 
vention. The dynamic image composition apparatus 
shown in Fig. 1 comprises a plurality of plot information 
generating means 1, one or more image management 
means 2 and a plotting means 3, and it combines and 
displays one or more images. 

[0007] Each plot information generating means 1 gen- 



2 

erates plot information used to plot a dynamic image. 
Each image management means 2 manages the image 
data of each image and generates the plot information 
at a present time of each image by combining one or 

5 more pieces of plot information generated by one or 
more of a plurality of plot information generating means 
2. The plotting means 3 receives both the image data 
and plot information at a present time from the image 
management means 2 and plots the image data based 

10 on the plot information at a present time. 

[0008] The plot information are generated for each im- 
age and includes information about the position coordi- 
nates on a screen of an image. When an image is re- 
produced, each of the plurality of plot information gen- 

15 erating means 1 generates plot information for plotting 
a different movement element, and the image manage- 
ment means 2 generates one piece of plot information 
by combining a plurality of pieces of plot information 
generated by the plurality of plot information generating 

20 means 1 . 

[0009] For example, if the first and second plot infor- 
mation generating means generate plot information for 
indicating the vertical vibration of a sine wave and plot 
information for indicating the rightward shift, respective- 

25 |y, plot information obtained by combining those pieces 
of plot information indicates a rightward shift with a ver- 
tical vibration along the locus of a sine wave. 
[0010] The plotting means 3 plots image data based 
on the plot information composed in this way and rep- 

30 resents a composed movement. If there are a plurality 
of image management means 2, the plotting means 3 
plots the image data based on plot information corre- 
sponding to each piece of image data and combines a 
plurality of images on a screen. 

35 [0011] In this way, a complex movement can be easily 
generated by combining a plurality of pieces of plot in- 
formation generated by a plurality of plot information 
generating means 1 , in real time when an image is re- 
produced. Since the plurality of image management 

40 means 2 can use one plot information generating means 
1 , one movement element can be used to plot a plurality 
of different images. 

[0012] Alternatively, a plot information generating 
means 1 can also be handled as a movement compo- 

4 5 nent for plotting an individual movement, and a plot in- 
formation generating means 1 can also be added/delet- 
ed according to an event generated while a dynamic im- 
age is reproduced. Therefore, the movement of an im- 
age can be modified by a user's input operation, etc. 

50 [0013] For example, the plot information generating 
means 1 shown in Fig. 1 corresponds to the plot infor- 
mation generating unit 23 shown in Fig. 2 and the plot 
information generating unit 41 shown in Fig. 4, which 
are both described later. The image management 

55 means 2 corresponds to the image management unit 1 1 
shown in Fig. 2. The plotting means 3 corresponds to 
the plotting unit 12, VRAM (video random access mem- 
ory) 13 and display 14 which are shown in Fig. 2. 
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Brief Description of Drawings 

[0014] Fig. 1 shows the basic configuration of the dy- 
namic image composition apparatus of the present in- 
vention. 

[0015] Fig. 2 shows the configuration of the first dy- 
namic image composition apparatus. 
[0016] Fig. 3 shows the configuration of the second 
dynamic image composition apparatus. 
[0017] Fig. 4 shows the configuration of the third dy- 
namic image composition apparatus. 
[0018] Fig. 5 shows the configuration of the fifth dy- 
namic image composition apparatus. 
[0019] Fig. 6 shows the first dynamic image compo- 
sition. 

[0020] Fig. 7 is a flowchart showing the first plot up- 
date process. 

[0021 ] Fig. 8 is a flowchart showing an event process. 
[0022] Fig. 9 is a flowchart showing the first plot infor- 
mation generating process. 

[0023] Fig. 10 is a flowchart showing a plot informa- 
tion function obtaining process. 

[0024] Fig. 1 1 shows the second dynamic image com- 
position. 

[0025] Fig. 12 is a flowchart showing the second plot 
information generating process. 
[0026] Fig. 13 shows a plot information string. 
[0027] Fig. 14 is a flowchart showing a plot informa- 
tion string obtaining process. 

[0028] Fig. 1 5 shows the third dynamic image compo- 
sition. 

[0029] Fig. 1 6 is a flowchart showing the second plot 
update process. 

[0030] Fig. 1 7 is a flowchart showing the third plot in- 
formation generating process. 

[0031 ] Fig. 1 8 shows the fourth dynamic image com- 
position. 

[0032] Fig. 19 is a flowchart showing the fourth plot 
information generating process. 
[0033] Fig. 20 shows the first dynamic image. 
[0034] Fig. 21 shows the fifth dynamic image compo- 
sition. 

[0035] Fig. 22 shows the second dynamic image. 
[0036] Fig. 23 shows the third dynamic image. 
[0037] Fig. 24 shows the configuration of an informa- 
tion processing device. 

[0038] Fig. 25 shows an example of storage media. 
[0039] Fig. 26 shows the configuration of the fifth dy- 
namic image composition apparatus. 

Best Mode for Carrying Out the Invention 

[0040] The preferred embodiments of the present in- 
vention are described in detail below with reference to 
the drawings. 

[0041] According to the present invention, a plurality 
of plot information generation units are provided for 
each image component, and the movement of each im- 



age component is composed in real time when an image 
is reproduced. For plot information, the position, size, 
rotation angle, color, sequential relationship, etc., of an 
image component are used., and the movement of each 

5 image component can be determined by providing plot 
information at each time. A complex movement can be 
easily generated by combining in real time a plurality of 
pieces of plot information generated by the plurality of 
plot information generating units. A movement element 

10 can be widely used by enabling the same movement el- 
ement to be referred by a plurality of plot information 
generating units. 

[0042] Fig. 2 shows the configuration of a dynamic im- 
age composition apparatus based on absolute plot in- 
15 formation. The dynamic image composition apparatus 
shown in Fig. 2 comprises one or more image manage- 
ment units 11 , a plotting unit 12, a VRAM 13 and a dis- 
play 14. 

[0043] The image management unit 1 1 is provided for 

20 each image component, and, for example, it passes 
both image data and plot information at a present time 
to the plotting unit 12 at appropriate intervals, such as 
once per frame, etc., or at dynamically determined in- 
tervals. The plotting unit 12 writes the image data, re- 

25 ceived from each image management unit 11, in the 
VRAM 1 3 based on the plot information and displays the 
data on the screen of the display 14. 
[0044] The image management unit 11 includes an 
image source 21, a memory 22 and one or more plot 

30 information generating units 23. The image source 21 
is, for example : a still image memory, a motion picture 
decoder, etc., and it generates image data to be written 
in the VRAM 1 3. Therefore, the data in the image source 
21 include arbitrary images, such as a still image, motion 

55 picture, character, symbol, etc. 

[0045] The plot information generating units 23 are 
linked to one another in an order relation. Each plot in- 
formation generating unit 23 calculates the absolute plot 
information at a present time according to a correspond- 

40 ing movement element, adds the calculation result at a 
present time to the plot information passed by a higher- 
order plot information generating unit 23 and passes the 
information to a lower-order plot information generating 
unit 23. 

45 [0046] The highest-order plot information generating 
unit 23 reads the plot information at a previous time from 
the memory 22, calculates plot information at a present 
time based on the information and passes the informa- 
tion to a lower-order plot information generating unit 23. 

50 The plot information at a present time outputted by the 
lowest-order plot information generating unit 23 is 
passed to the plotting unit 12 and is simultaneously writ- 
ten in the memory 22. 

[0047] In this case, the order, type and number of the 
55 plot information generating units can be fixed or can be 
dynamically changed according to time, by a user's op- 
eration, etc. The plot information generating unit 23 can 
be configured by software or hardware. 
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[0048] The dynamic image composition apparatus 
shown in Fig. 2 can be implemented, for example, by 
the configuration shown in Fig. 3. The dynamic image 
composition apparatus shown in Fig. 3 further compris- 
es a plot information string management unit 31 in ad- 5 
dition to the constituent components shown in Fig. 2. 
[0049] The plot information string management unit 

31 stores one or more plot information strings 32, and 
these plot information strings 32 are identified by iden- 
tifiers (indexes). The plot information string 32 is a list 10 
of a plurality of pieces of plot information at arbitrarily 
discrete times, and it describes respective pieces of plot 
information at each time of, for example, 0, 10, 60 and 

65 seconds. 

[0050] Each plot information generating unit 23 stores 15 
both an identifier 33 for referring to the plot information 
string 32 and a modification parameter 34 for modifying 
plot information. At a specific time, the plot information 
generating unit 23 extracts two pieces of plot information 
before and after the time from the plot information string 20 

32 in the plot information string management unit 31 cor- 
responding to the identifier 33. Then, the plot informa- 
tion generating unit 23 calculates plot information at a 
present time by a method of performing interpolation us- 
ing the extracted plot information, etc. 25 
[0051] Then, the plot information generating unit 23 
enlarges or reduces the calculated plot information by 

the parameter 34, adds the calculation result at a 
present time to the plot information passed by a higher- 
order plot information generating unit 23 and passes the 30 
information to a lower-order plot information generating 
unit 23. The parameter34 can be not only applied to plot 
information itself, but it can also be applied to a time 
when the plot information is extracted. By changing a 
time in this way, the movement speed of an image can 35 
be changed. 

[0052] Fig. 4 shows a dynamic image composition ap- 
paratus based on the difference between two pieces of 
plot information. The dynamic image composition appa- 
ratus shown in Fig. 4 comprises one or more image 40 
management units 1 1 , a plotting unit 1 2, a VRAM 1 3 and 
a display 14 like the dynamic image composition appa- 
ratus shown in Fig. 2. 

[0053] The image management unit 11 includes an 
image source 21 , a memory 22, one or more plot infor- 45 
mation generating units 41 and adders 42 and 43. Each 
plot information generating unit 41 calculates the differ- 
ence in plot information (difference plot information) be- 
tween a previous time and a present time according to 
a corresponding movement element, and adds the dif- so 
ference to the adder 43. 

[0054] The adder 43 totals a plurality of pieces of the 
difference plot information at a present time outputted 
by the plot information generating units 41 , and the 
adder 42 obtains plot information at a present time by 55 
adding the totaled difference plot information at a 
present time to plot information at a previous time read 
from the memory 22. The plot information at a present 



time outputted from the adder 42 is passed to the plot- 
ting unit 12 and is simultaneously stored in the memory 
22. 

[0055] In this case, the type and number of the plot 
information generating units 41 can be fixed or can be 
dynamically changed according to time, by a user's op- 
eration, etc. The operational orderof the plot information 
generating units 41 does not have to be specially des- 
ignated and they can also be operated in parallel. The 
plot information generating units 41 can be configured 
by software or hardware. 

[0056] The dynamic image composition apparatus 
shown in Fig. 4 can be implemented, for example, by a 
configuration, as shown in Fig. 5. 

[0057] The dynamic image composition apparatus 
shown in Fig. 5 further comprises the plot information 
string management unit 31 shown in Fig. 3 in addition 
to the constituent components shown in Fig. 4. 
[0058] Each plot information generating unit 41 stores 
both an identifier 33 for referring to the plot information 
string 32 and a modification parameter 34 for modifying 
plot information like the plot information generating unit 
23 shown in Fig. 3. The plot information generating unit 
41 calculates difference plot information at a present 
time by a method of performing interpolation based on 
the plot information extracted from the plot information 
string management unit 31 using the identifier 33, etc. 
Then, the plot information generating unit 41 enlarges 
or reduces the calculated difference plot information by 
the parameter 34 and outputs the calculation result to 
the adder 43. 

[0059] Next, the operation of the dynamic image com- 
position apparatus described above is described in de- 
tail. Here, a plot process in the case where the image 
management unit 11 and plotting unit 12 are configured 
by reproduction software is mainly described. 
[0060] It is assumed that the data of the image source 
21 , the data of the plot information string management 
unit 31 , the programs of the plot information generating 
units 23 and 41, the program of the plotting unit 12, etc., 
are already read and expanded in the memory of a com- 
puter. For example, if the image source 21 is an MPEG 
(Moving Picture Experts Group) decoder, motion picture 
data after image expansion are read into the memory. 
[0061] The plotting unit 12 stores a variable in order 
to receive an event notice from another event control 
unit, such as an event loop, etc. For the event, an arbi- 
trary form, such as a user's input operation, interruption 
by the system, etc., and the event is not limited to a spe- 
cific form. 

[0062] Although for the plot update interval, a specific 
value dt is used, the same fundamental algorithm can 
be applied even if an update interval is dynamically 
changed depending on the function of reproduction 
hardware, etc. Generally, the longer the update interval, 
the smaller the plotting frequency and the higher the 
plotting speed. Therefore, a real time process can be 
implemented by appropriately adjusting an update inter- 
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val. 

[0063] Although for plot information, two-dimensional 
coordinates corresponding to the position at which an 
image is displayed are used, the same fundamental al- 
gorithm can also be applied, even if other plot informa- 
tion, such as the size, rotation angle, etc., of an image 
is used. 

[0064] Although for the data included in the plot infor- 
mation string 32, an identifier, time and two-dimensional 
coordinate string are used, the overall algorithm does 
not change, even if information indicating a more com- 
plex movement is included. Since the plot information 
generating units 23 and 41 store respective unique in- 
ternal times and coordinate spaces, different move- 
ments can be represented by one plot information string 
32. 

[0065] Fig. 6 shows a dynamic image composition 
process in the case where a plot information function is 
used instead of the plot information string 32 in the con- 
figuration shown in Fig. 3. The plot information function 
management unit 51 shown in Fig. 6 stores one or more 
plot information functions 52 in the form of a list, and 
these plot information functions 52 can be identified by 
identifiers. 

[0066] The plotting unit 12 stores a list 61 of pointers 
to an arbitrary number of image management units 11 , 
a variable 62 for receiving an event notice and an image 
update interval 63. A pointer plmagei (i=1 ,2,...,M) in- 
cluded in the list 61 indicates an image management 
unit #i. 

[0067] Each image management unit 11 stores the 
data 64 of the image source 21 , the most recent plot 
coordinates 65 at a previous time corresponding to the 
memory 22, the plot coordinates 66 and the highest-or- 
der image information generating unit #1 , and the plot 
information generating unit #i (i=1, 2,...,N-1) stores 
pointer 1 pi to a lower-order plot information generating 
unit #(i+1). However, the lowest-order plot information 
generating unit #N stores no pointer to another plot in- 
formation generating unit 23. 

[0068] Each plot information generating unit #i 
(i=1 ,2,...,N) stores a plot information function identifier 
pfk (k=1,2 K), a speed parameter speedi, scale pa- 
rameters x_scalei and y_scalei and an internal time 
tjasti. 

[0069] Since the identifier pfk corresponds to the plot 
information function 52 of the plot information function 
management unit 51 , each plot information generating 
unit 23 can refer to an arbitrary information function 52. 
Therefore, one plot information function 52 can some- 
times be referred by a plurality of plot information gen- 
erating units 23 in one image management unit 11 and 
can sometimes be referred by the respective plot infor- 
mation generating units 23 in a plurality of image man- 
agement units 11 . 

[0070] Fig. 7 is a flowchart showing the plot update 
process of the dynamic image composition apparatus 
shown in Fig. 6. M pieces of image data 64 of image 
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management units #1-#M are sequentially plotted on 
coordinates generated via plot information generating 
units #1 -#N by one plot update process. A loop a corre- 
sponds to a process of calling up each plot management 
5 unit 1 1 and the process is repeated M times. 

[0071] At loop a, the image management unit 11 as- 
signs the last plot coordinates (xjast, yjast) at a pre- 
vious time to plot coordinates (x, y) (step S1 ) and it per- 
forms an event process (step S2). In the event process, 

10 event information which is notified to the plotting unit 1 2 
during an update interval dt and stored in a variable 
Event, is identified and the plot information generating 
units 23 are dynamically reorganized, if required. The 
details of this event process are described later. 

15 [0072] Then, the highest-order plot information gen- 
erating unit #1 is called up and the change of the plot 
coordinates during the update interval dt is calculated 
(step S3). At this time, if there are lower-order plot infor- 
mation generating units 23, the units are recurrently 

20 called up and plot coordinates (x, y) outputted by the 
lowest-order plot information generating unit #N are 
passed to the plotting unit 12 as plot coordinates at a 
present time. The details of this plot information gener- 
ating process are described later. 

25 [0073] Then, the image management unit 11 assigns 
the obtained coordinates (x, y) to coordinates (xjast, 
yjast) (step S4), and the plotting unit 1 2 plots the image 
data 64 at the position of the coordinates (x, y) (step S5). 
[0074] When the loop a processes of all image man- 

30 agement units 11 are completed, the plotting unit 12 
clears the variable Event in order to receive a new event 
notice (step S6) and terminates the process. 
[0075] Fig. 8 is a flowchart showing the event process 
in step S2 shown in Fig. 7. The event information stored 

35 jn the variable Event of the plotting unit 12 includes both 
the identifier of the image data 64 and a flag indicating 
that a new plot information generating unit 23 should be 
generated or that an existing plot information generating 
unit 23 should be deleted. The event information also 

*o includes additional information for designating a plot in- 
formation generating unit 23 to be generated/deleted. 
[0076] On receipt of the event information from the 
plotting unit 12, the image management unit 11 judges 
from the identifier whether the image data 64 being proc- 

45 essed are the target of the event notice (step S1 1 ) . If the 
image data 64 being processed are not the target, the 
image management unit 11 terminates the process. If 
the image data are the target, the image management 
unit 11 adds/deletes a plot information generating unit 

50 23 using both the flag and additional information. 

[0077] Here, the image management unit 11 judges 
whether the flag indicates the addition of a plot informa- 
tion generating unit (step S12). If it is judged that the 
flag indicates the addition, the image management unit 

55 11 adds a plot information generating unit 23 designated 
by the additional information (step S13) and terminates 
the process. If it is judged that the flag does not indicates 
the addition, the image management unit 11 deletes a 
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plot information generating unit 23 designated by the ad- 
ditional information (step S14) and terminates the proc- 
ess. 

[0078] The addition/deletion of a plot information gen- 
erating unit 23 can be implemented, for example, by 
adding data to the list of plot information generating units 
23 stored by the image management unit 11 and delet- 
ing data from the list. At this time, pointers between plot 
information generating units 23 are reorganized, if re- 
quired. 

[0079] The complex movement of an image can be 
dynamically changed by such a dynamic reorganization 
process of plot information generating units 23. For ex- 
ample, by deleting a plot information generating unit 23 
only for a single vibration or only for a parallel shift from 
the image management unit 11 for an image which is 
obtained by combining the single vibration and parallel 
shift and which moves in the form of a sine wave, the 
present movement of the image can be transferred to 
another simpler movement. By adding a plot information 
generating unit 23 for single vibration to the image man- 
agement unit 11 of an image which moves in parallel, 
the present movement of the image can be transferred 
to another more complex movement. 
[0080] Fig. 9 is a flowchart showing the plot informa- 
tion generating process in step S3 shown in Fig. 7. The 
highest-order plot information generating unit #1 exe- 
cutes a process using both an update interval dt and plot 
coordinates (x, y) as inputs, and outputs updated plot 
coordinates (x, y). 

[0081] The plot information generating unit #1 first 
multiplies the update interval dt by a parameter, speedl 
to convert a global update interval dt to the internal up- 
date interval dt1 of the plot information generating unit 
#1 (step S21). 

[0082] Then, the plot information generating unit #1 
obtains a plot information function f1 (tjast, dt, x, y) cor- 
responding to a plot information function identifier pf 1 
from the plot information function management unit 51 
(step S22). This plot information function obtaining proc- 
ess is described later. Then, the plot information gener- 
ating unit #1 calculates new plot coordinates (x, y) ac- 
cording to the following equation using an internal time 
t_last1 calculated at a previous time, the internal update 
interval dtt and the inputted plot coordinates (x, y) (step 
S23). 

(x,y) = f1 (tjastl ,dt1,x,y) (1) 

[0083] Equation (1) indicates that x and y are calcu- 
lated as functions of t_last1 , dt1 , x and y. For f 1 (tjastl , 
dt1, x, y), for example, a function in which x=0, y=sin 
(tjastl +dt1) : is used. 

[0084] Then, in order to convert the obtained plot co- 
ordinates (x, y) from the internal coordinate space to a 
global coordinate space, x and y are multiplied by a pa- 
rameter x_scale1 and y_scale1 , respectively, and the 



results are assigned to x and y, respectively (step S24). 
[0085] Then, the plot information generating unit #1 
updates the internal time by assigning 
tjastl =t_last1+dt1 (step S25) and judges whether 
5 there is a lower-order plot information generating unit 
23 (step S26). In this case, if there is a pointer 1p1 to 
the lower-order information generating unit 23, it is 
judged that there is a lower-order plot information gen- 
erating unit 23. If there is no lower-order plot information 

to generating unit 23, the plot coordinates (x,. y) are out- 
putted as the result of one update process. 
[0086] If there is a lower-order plot information gen- 
erating unit 23, the plot information generating unit #1 
calls up the lower-order plot information generating unit 

15 23, provides the lower-order plot information generating 
unit 23 with both the update interval dt and obtained plot 
coordinates (x, y) as inputs and makes the lower-order 
plot information generating unit 23 execute the same 
plot information generating process (step S27). In this 

20 case, the plot information generating process shown in 
Fig. 9 is recurrently called up and the process of a plot 
information generating unit #i is executed. 
[0087] At this time, the plot information generating unit 
#i calculates dt1=dt*speedi in step S21, obtains a plot 

25 information function fk(t_last, dt, x, y) corresponding to 
the identifier pfk in step S22 and calculates the plot co- 
ordinates (x, y) according to the following equation in 
step S23. 

30 

(x, y) = fk(tjasti, dt1 , x, y) (2) 

[0088] The plot information generating unit #i calcu- 
lates x=x*x_scalei and y=y*y_scalei in step S24, calcu- 
35 lates tjasti=tjasti+dt1 in step S25 and judges whether 
there is a pointer 1 pi in step S26. 

[0089] If in step S26 there is a lower-order plot infor- 
mation generating unit 23, the plot information generat- 
ing unit #i calls up the lower-order plot information gen- 

40 erating unit 23. If there is no lower-order plot information 
generating unit 23, the plot information generating unit 
#i outputs the obtained plot coordinates (x, y) to the orig- 
inal higher-order plot information generating unit 23 and 
terminates the process. 

45 [0090] On receipt of the plot coordinates from the low- 
er-order plot information generating unit 23, the higher- 
order plot information generating unit 23 sequentially 
passes the plot coordinates to other higher-order plot 
information generating units 23 and the highest plot in- 

50 formation generating unit #1 outputs the received plot 
coordinates as the result of one update process. 
[0091] By such a plot information generating process, 
a plurality of plot information generated by a plurality of 
pieces of plot information generating units 23 can be 

55 combined in real time and they can be supplied to the 
plotting unit 12. Therefore, the complex movement of an 
image can be easily generated by automatically repeat- 
ing the update of the image. 
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[0092] Fig. 1 0 is a flowchart showing the plot informa- 
tion function obtaining process in step S22 shown in Fig. 
9. When the plot information generating unit #i passes 
the identifier pfk to the plot information function man- 
agement unit 51 , the plot information function manage- 
ment unit 51 executes the loop a process. Loop a is re- 
peated K times in correspondence with the number of 
plot information functions. 

[0093] In loop a, the plot information function manage- 
ment unit 51 compares the inputted identifier pfk with 
the identifier of one plot information function 52 (step 
S31). If the identifiers match, the plot information func- 
tion management unit 51 outputs a plot information func- 
tion 52 corresponding to the identifier pfk (step S32) and 
terminates the process. If the identifiers do not match, 
the plot information function management unit 51 re- 
peats a process of comparing the identifier pfk with the 
identifier of a subsequent plot information function 52. 
[0094] Fig. 11 shows a dynamic image composition 
process in the case where the configuration shown in 
Fig. 3 is used. The plot information string management 
unit 31 shown in Fig. 11 stores one or more plot infor- 
mation strings 32 in the form of a list, and these plot 
information strings 32 are identified by identifiers. Each 
plot information string 32 includes a string of discrete 
times and plot coordinate values. 
[0095] The list 6 1 , event variable 62 and update inter- 
val 63 of the plotting unit 12, and the image data 64, last 
plot coordinates 65 and plot coordinates 66 of the image 
management unit 11 are the same as those shown in 
Fig. 6. Each plot information generating unit #i (i=1 ,2,..., 
N) stores an information string identifier IDk (k=1,2,..., 
K) instead of the plot information function identifier 
shown in Fig. 6. 

[0096] Since the identifier IDk corresponds to the plot 
information string 32 of the plot information string man- 
agement unit 31, each plot information generating unit 
23 can refer to an arbitrary plot information string 32. 
Therefore, one plot information string 32 can sometimes 
be referred by a plurality of plot information generating 
units 23 in one image management unit 11 and can 
sometimes be referred by the respective plot informa- 
tion generating units 23 in a plurality of image manage- 
ment units 11 . 

[0097] The plot information generating unit #i stores 
a difference calculation flag bDiffi as one of the param- 
eters. The plot information generating unit #i adds a dif- 
ference to inputted plot coordinates and outputs the co- 
ordinates if this bDiffi value is true, and it outputs abso- 
lute plot coordinates regardless of inputted plot coordi- 
nates if the bDiffi value is false. 

[0098] The plot update process of the dynamic image 
composition apparatus shown in Fig. 11 is basically the 
same as that shown in Fig. 7. However, instep S3 shown 
in Fig. 7, the highest-order plot information generating 
unit #1 executes the plot information generating process 
shown in Fig. 12 using both an update interval dt and 
plot coordinates (x, y) as inputs and it outputs the up- 
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dated plot coordinates (x, y). 

[0099] The plot information generating unit #1 first 
converts the update interval dtto an internal update in- 
terval dt1 by multiplying the update interval dt by a pa- 
5 rameter speedl (step S41 ) and obtains a plot information 
string corresponding to a plot information string identifier 
ID1 (step S42). This plot information string obtaining 
process is described later. 

[0100] Then, the plot information generating unit #1 
10 obtains coordinate values at times before and after 
t_last1 and t_last1+dt1, and calculates the coordinate 
change difference (dx, dy) between t_last1 and 
t_last1+dt1 by interpolation using those coordinate val- 
ues (step S43). This difference (dx, dy) corresponds to 
15 the movement amount of an image during the internal 
update interval dt1 . 

[0101] For example, if the plot information string 
shown in Fig. 13 is obtained, the difference (dx ; dy) is 
calculated as follows. However, it is assumed that 

20 t1 <t2<t3<...<tJ is satisfied, x1 , x2, x3 xJ are different 

and y1, y2, y3, yJ are different. 
[0102] First, in the case of t1 <t_last1 <t_last1 +dt1 <t2, 
the difference (dx, dy) is calculated according to the fol- 
lowing equations. 

25 

dx=(x2-x1)*dt1/(t2-t1) 
dy=(y2-y1)*dt1/(t2-t1) (3) 

30 

[0103] In the case of t1<tjast1<t2<... 
<tj<t_last1+dt1 <t(j+1), the difference (dx, dy) is calcu- 
lated according to the following equations. 

35 dx=(x2-x1 )*(t2-tjast1)/(t2- 11 ) 

+xj-x2 



+(xG+1 )-xj)*(t_last1 +dt1 -tj)/(tG+1 )-tj) 

dy=(y2-y1 )*(t2-t_last1 )/(t2-t1 ) (4) 



+yj-y2 



+(yG+i )-yj)*(tjasti +dti -tj)/(t(j+i )-tj) 

50 

[0104] In the case of t_last1 <tJ<t_last1 +dt1 , the dif- 
ference (dx, dy) is calculated according to the following 
equations. 

55 dx=(xJ-x(J-1 ))*(tJ-t Jastl )/(tJ-t(J-1 )) 

dy=(yJ-y(J-1 ))*(tJ-t_last1 )/(tJ-t(J-1 )) (5) 
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[0105] In the case of tjastl >tJ, the difference (dx, dy) 
is calculated according to the following equations. 

dx=0 

dy=0 (6) 

[0106] Although these equations (3), (4), (5) and (6) 
are an example of linear interpolation, a more complex 
interpolation method can also be used when a differ- 
ence (dx, dy) is obtained from plot information string da- 
ta. 

[0107] After the difference (dx, dy) is obtained, the plot 
information generating unit #1 multiplies coordinates dx 
and dy by parameters x_scale1 and y_scale1 , respec- 
tively, and assigns the results to coordinates dx and dy, 
respectively (step S44). Then, the plot information gen- 
erating unit #1 judges the value of the difference calcu- 
lation flag bDiffl (step S45). 

[0108] If the value of the flag bDiffl is true, the plot 
information generating unit #1 adds the difference (dx, 
dy) to inputted plot coordinates (x, y) and assigns the 
result to the coordinates (x, y) (step S46). If the value of 
the flag bDiffl is false, the plot information generating 
unit #1 assigns the difference (dx, dy) to the coordinates 
(x, y) with no addition (step S47). In this case, the input- 
ted plot coordinates (x, y) are cancelled and new coor- 
dinates (x, y) are generated. 

[0109] Then, the plot information generating unit #1 
updates the internal time by assigning 
tjastl =t_last1+dt1 (step S48) and judges whether 
there is a lower-order plot information generating unit 
23 (step S49). If there is no lower-order plot information 
generating unit 23, the plot information generating unit 
#1 outputs the plot coordinates (x, y) as a result of one 
update process. 

[01 1 0] If there is a lower-order information generating 
unit 23, the plot information generating unit #1 calls up 
the lower-order information generating unit 23, provides 
the lower-order information generating unit 23 with both 
the update interval dt and obtained plot coordinates (x, 
y) as inputs and makes the lower-order information gen- 
erating unit 23 execute the same plot information gen- 
erating process (step S50). In this case, the plot infor- 
mation generating process shown in Fig. 12 is recurrent- 
ly called up and the process of the plot information gen- 
erating unit #i is executed. 

[0111] In this case, the plot information generating 
unit #i calculates dt1 =dt*speedi in step S41, obtains a 
plot information string corresponding to the identifier IDk 
in step S42 and calculates the coordinate change differ- 
ence (dx, dy) between tjasti and t_lasti+dt1 based on 
the plot information string. 

[01 1 2] The plot information generating unit #i also cal- 
culates x=x*x_scalei and y=y*y_scalei instep S44, also 
judges the value of the difference calculation flag bDiffi 
in step S45, also calculates t_lasti=t_lasti+dt1 in step 



S48 and judges whether there is a pointer 1 pi in step 
S49. 

[0113] If in step S49 there is a lower-order plot infor- 
mation generating unit 23, the plot information generat- 

5 ing unit #i calls up the lower-order plot information gen- 
erating unit 23. If there is no lower-order plot information 
generating unit 23, the plot information generating unit 
#i outputs the plot coordinates (x, y) to the original high- 
er-order plot information generating unit 23 and termi- 

10 nates the process. 

[01 1 4] On receipt of the plot coordinates from the low- 
er-order plot information generating unit 23, the higher- 
order plot information generating unit 23 sequentially 
passes the plot coordinates to another higher-order plot 

15 information generating unit 23. The highest-order plot 
information generating unit #1 outputs the received plot 
coordinates as a result of one update process. By such 
a plot information generating process, the plot informa- 
tion generating unit 23 can generate plot information us- 

20 ing a plot information string instead of a plot information 
function. 

[0115] Fig. 14 is a flowchart showing the plot informa- 
tion string obtaining process in step S42 shown in Fig. 
12. When the plot information generating unit #i passes 

25 the identifier IDk to the plot information string manage- 
ment unit 31, the plot information string management 
unit 31 executes a loop a process. Loop a is repeated 
K times corresponding to the number of the plot infor- 
mation strings 32. 

30 [0116] In loop a : the plot information string manage- 
ment unit 31 compares the inputted identifier IDk with 
the identifier of one plot information string 32 (step S51 ). 
If the identifiers match, the plot information string man- 
agement unit 31 outputs a plot information string 32 cor- 

35 responding to the identifier IDk (step S52), and termi- 
nates the process. If the identifiers do not match, the 
plot information string management unit 31 repeats the 
process of comparing the identifier I Dk with the identifier 
of a subsequent plot information string 32. 

40 [0117] According to the dynamic image composition 
apparatus shown in Figs. 6 and 11 , each plot information 
generating unit 23 can cancel plot information passed 
from a higher-order plot information generating unit 23 
and can generate a new piece of plot information. There- 

45 fore, for example, the movement of an image can also 
be stopped at a specific predetermined time. 
[0118] Generally, if each plot information generating 
unit 23 generates absolute plot information using the 
plot information from a higher-order plot information 

50 generating unit 23 as an input, plot information outputted 
from the image management unit 11 is affected by the 
operation order of the plot information generating unit 
23. 

[0119] For example, a case is considered where the 
55 image management unit 11 includes two plot informa- 
tion generating units #1 and #2, the plot information gen- 
erating unit #1 generates the plot information about a 
vertical vibration on a screen and the plot information 
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generating unit #2 generates plot information which 
moves rightward between time 0 and time t1 and stops 
at time t1 . 

[0120] In this case, the plot information generating 
units #1 and #2 are operated in that order. Lastly, plot 
information of an image which moves rightward while 
vertically vibrating between times 0 and t1 and stops 
there at and after time t1 , is outputted. If the plot infor- 
mation generating units #2 and #1 are operated in that 
order, lastly, plot information of an image which moves 
rightward while vertically vibrating between times 0 and 
t1 and it vertically vibrates there at and after time t1 , is 
outputted. Therefore, the composition movement differs 
depending on the operation order of the plot information 
generating units #1 and #2. 

[01 21 ] Fig. 1 5 shows the dynamic image composition 
process in the case where a plot information function 52 
is used instead of a plot information string 32 in the con- 
figuration shown in Fig. 5. The pointer list 61 , event var- 
iable 62 and update interval 63 of the plotting unit 12; 
the image data 64, last plot coordinates 65 and plot co- 
ordinates 66 of the image management unit 1 1 ; informa- 
tion stored in the plot information generating units 41; 
and the plot information function management 51 which 
are all shown in Fig. 15 are the same as those shown 
in Fig. 6. 

[0122] Each image management unit 11 also stores 
difference coordinates 67 and further stores one or more 
plot information generating units 41 in the form of a list. 
[0123] Fig. 16 is a flowchart showing the plot update 
process of the dynamic image composition apparatus 
shown in Fig 15. By one plot update process, Mpieces 
of image data of the image management units #1-#M 
are sequentially plotted on coordinates generated by the 
plot information generating units #1-#N. A loop a corre- 
sponds to a process of calling up each image manage- 
ment unit 11 and is repeated M times. A loop b corre- 
sponds to a process of calling up each plot information 
generating unit 41 and is repeated N times. 
[0124] In loop a, the image management unit 11 exe- 
cutes the event process shown in Fig. 8 (step S61), as- 
signs the last plot coordinates (xjast, y last) at a previ- 
ous time to plot coordinates (x, y) (step S62) and exe- 
cutes the process of loop b. 

[0125] In loop b, the plot information generating unit 
41 is called up. and coordinate change difference (dx, 
dy) during an update interval dt is calculated (step S63). 
The details of this plot information generating process 
are described later. Then, the obtained difference (dx, 
dy) is added to the plot coordinates (x, y), and the result 
is assigned to the plot coordinates (x, y) (step S64). 
[0126] As for loop b, lower-order plot information gen- 
erating units #(i+1 ) can be sequentially called up tracing 
a pointer ipi from the highest-order plot information gen- 
erating unit #1 or the plot information generating units 
#1-#N can be operated in parallel. 
[0127] After the loop b processes of all plot informa- 
tion generating units 41 are completed, the image man- 
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agement unit 1 1 assigns the obtained coordinates (x, y) 
to coordinates (xjast, yjast) (step S65), and the plot- 
ting unit 1 2 plots the image data 64 at the position of the 
plot coordinates (x, y) (step S66). 

5 [0128] After the loop a processes of all image man- 
agement units 11 are completed, the plotting unit 12 
clears the variable Event to receive a new event notice 
(step S67) and terminates the process. 
[0129] Fig. 1 7 is a flowchart showing the plot informa- 

10 tion generating process in step S63 shown in Fig. 16. 
The plot information generating unit #i executes a proc- 
ess using an update interval dt as an input and outputs 
a plot coordinate difference (dx, dy). 
[0130] The plot information generating unit #i first mul- 

15 tiplies the update interval dt by a parameter speedi and 
converts the update interval dt to an internal update in- 
terval dt1 (step S71). Then, the plot information gener- 
ating unit #i obtains a plot information function fk(t) cor- 
responding to a plot information function identifier pfk 

20 from the plot information function management unit 51 
by executing the plot information function obtaining 
process shown in Fig. 10(stepS72). Here; it is assumed 
that fk(t) is expressed by the following equation. 

fk(t)=(fkx(t), fky(t)) (7) 

The plot information generating unit #i calculates the dif- 
ference (dx, dy) according to the following equation us- 
30 jng both an internal time t_last1 calculated at a previous 
time and the internal update interval dt1 (step S73). 

dx=fkx(t Jasti+dt1 )-f kx(tjasti) 
55 dy=fky(t_lasti+dt1)-fky(tjasti) (8) (8) 

[0131] Equation (8) indicates the respective differenc- 
es of functions fkx(t) and fky(t) between internal times 
40 tjasti and t_lasti+dt1 . 

[0132] Then, the plot information generating unit #i 
multiplies the obtained differences (dx, dy) by parame- 
ters x_scalei and y_scalei, respectively, and the results 
are assigned to the differences dx and dy, respectively 
45 (step S74). Then, the plot information generating unit #i 
updates the internal time by assigning 
t_lasti=t_lasti+dt1 (step S75), outputs the difference (dx, 
dy) and terminates the process. 

[0133] The difference (dx, dy) outputted by each plot 
50 information generating unit #i is added to the plot coor- 
dinates (x, y) in step S64 shown in Fig. 1 6 and lastly the 
plot coordinates (x, y) are updated by the sum of differ- 
ences (dx, dy) outputted by all plot information generat- 
ing units 41 . 

55 [0134] By such a plot information generating process, 
a plurality of pieces of plot information generated by a plu- 
rality of plot information generating units 41 can be com- 
bined in real time when an image is updated and they can 
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be provided to the plotting unit 1 2. Therefore, the complex 
movement of an image can be easily generated by auto- 
matically repeating the update of the image. 
[0135] Fig. 18 shows the dynamic image composition 
process in the case of the configuration shown in Fig. 5. 5 
The pointer list 61 , event variable 62 and update interval 
63 of the plotting unit 12; and the image data 64, last 
plot coordinates 65, plot coordinates 66 and difference 
coordinates 67 of the image management unit 11 shown 
in Fig. 1 8 are the same as those shown in Fig. 1 5. Both 10 
pieces of information stored in the plot information gen- 
erating unit 41 and the plot information string manage- 
ment unit 31 are the same as those shown in Fig. 11 . 
However, the plot information generating unit 41 does 
not store a difference calculation flag. 15 
[0136] The plot update process of the dynamic image 
composition apparatus shown in Fig. 1 8 is basically the 
same as that shown in Fig. 16. However in step S63 
shown in Fig. 1 6, the plot information generating unit 41 
executes the plot information generating process shown 20 
in Fig. 19 using an update interval dt as an input and 
outputs plot coordinate difference (dx, dy). 
[01 37] The plot information generating unit #i first mul- 
tiplies the update interval dt by a parameter speedL con- 
verts the update interval dt to an internal update interval 25 
dt1 (step S81) and obtains a plot information string cor- 
responding to a plot information identifier IDk from the 
plot information string management unit 31 by executing 
the plot information string obtaining process shown in 
Fig. 14 (step S82). 30 
[0138] Then, the plot information generating unit #i 
obtains coordinate values at times before and after 
tjasti and t_lasti+dt1 from the plot information string 
and calculates the coordinate change difference (dx, dy) 
between tjasti and tjasti+dt1 by performing interpola- 35 
tion using these coordinate values (step S83). 
[0139] Then, the plot information generating unit #i 
multiplies the obtained differences dx and dy by param- 
eters x_scalei and y_scalei, respectively, and assigns 
the results to the differences dx and dy (step S84) .Then, <*o 
the plot information generating unit #i updates an inter- 
nal time by assigning t_lasti=t_lasti+dt1 (step S85), out- 
puts a difference (dx, dy) and terminates the process. 
By such a plot information generating process, the plot 
information generating unit 41 can generate plot infor- 45 
mation using a plot information string instead of a plot 
information function. 

[0140] Although in the preferred embodiments de- 
scribed above, the pointer 61 to the image management 
unit 1 1 , plot information generating units 23 and 41 , plot so 
information function 52 and plot information string 32 are 
stored in the form of a list, these can be stored in an 
arbitrary form only if it is a structure where an element 
can be added/deleted. 

[0141] Next, the specific example of dynamic image 55 
composition is described with reference to Figs. 20 
through 23. 

[0142] Fig. 20 shows a screen structure at time t=0. 
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On this screen, an xy coordinate system having the up- 
per left corner as an origin is established and three im- 
ages 11, 12 and 13 are plotted in a state where a plot 
position (x, y) is changed as time elapses. 
[0143] Fig. 21 shows the dynamic image composition 
process by image management units 11 for managing 
these images. In this example, the dynamic image com- 
position apparatus shown in Fig. 5 is used and both a 
plot information function 52 and a plot information string 
32 are used. 

[0144] The image management unit 11 of image 11 
stores image data 64, the most recent plot coordinates 
(x1 , y1 ) and two plot information generating units #1 and 
#2, the image management unit 11 of image 12 stores 
image data 64, the most recent plot coordinates (x2, y2) 
and one plot information generating unit 41 , and the im- 
age management unit 1 1 of image 13 stores image data 
64, the most recent plot coordinates (x3, y3) and one 
plot information generating unit 41 . 
[0145] The plot information generating unit #1 of im- 
age 11 stores a plot information function identifier pf1 , 
and the plot information generating unit #2 stores a plot 
information function identifier pf2. The plot information 
generating unit 41 of image 12 stores a plot information 
function identifier pf2, and the plot information generat- 
ing unit 41 of image 13 stores a plot information string 
identifier ID1 . 

[0146] Each plot information generating unit 41 calcu- 
lates a position coordinate difference (dx, dy) using an 
update interval dt to be inputted and a stored last update 
time tjasti and using a designated plot information func- 
tion 52 or plot information string 32. In this example, the 
difference (dx, dy) is directly provided by each plot in- 
formation function 52 and it is defined as follows. 

-Plot information function pf1 

[0147] 

dx=0 

dy=100*(sin(tjast+dt)-sin(tjast)) (9) 

[0148] According to this function, an x-direction differ- 
ence dx is 0 and a y-direction difference dy is equal to 
100 times the difference of sin (t) between times tjast 
and tjast+dt. As a result, this function indicates a ver- 
tical vibration with an amplitude of 100. 

-Plotinformation function pf2 

[0149] 

dx=10*dt 
dy=0 (10) 
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[0150] According to this function, an x-direction differ- 
ence dx is equal to ten times the update interval dt and 
a y-direction difference is 0. As a result, this function 
indicates a linear shift which is made by 10 shifts per 
unit time in the x-direction (rightward). 5 
[01 51 ] The plot information string 32 includes position 
coordinates for the four vertices of a square with each 
side of 1 00, and a locus designated by the plot informa- 
tion string 32 indicates a clockwise shift along the four 
sides of the square with an upper left vertex as a start 10 
point. In this case, the difference (dx, dy) is calculated 
based on the designated locus by performing a linear 
interpolation. 

[0152] Each image management unit 11 calculates 
position coordinates (x, y) as follows using the differ- 15 
ence (dx, dy) calculated by these plot information func- 
tions 52 orplot information strings 32. 

-Image management unit 11 of image 11 

20 

[0153] The plot information generating unit #1 calcu- 
lates the difference of a vertical vibration using a plot 
information function pf1 and the plot information gener- 
ating unit #2 calculates the difference of a rightward shift 
using a plot information function pf2. The sum of these 25 
two differences becomes the change amount of position 
coordinates in one update. As a result, image 11 moves 
along the locus of a sine wave. 

-Image management unit 11 of image 12 30 

[0154] The plot information generating unit 41 calcu- 
lates the difference of a rightward shift using a plot in- 
formation function pf2 and the difference becomes the 
change amount of position coordinates in one update. 35 
As a result, image 12 linearly moves rightward. 

-Image management unit 11 of image 13 

[0155] The plot information generating unit 41 calcu- 40 
lates the difference of a shift along a square using a plot 
information string ID1 , and the difference becomes the 
change amount of position coordinates in one update. 
As a result, image 13 moves along a locus designated 
by the plot information string ID1 . 45 
[01 56] Here, a case is considered where in such a dy- 
namic image composition process, notification of a spe- 
cific event is posted at time t=1 and an event process is 
executed. In this case, at time t=0, each image is plotted 
in the initial position, as shown in Fig. 20. Between times so 
t=0 and t=1 , each image moves according to a differ- 
ence generated by each plot information generating unit 
41 and added to the position coordinates, as shown in 
Fig. 22. Therefore, image 11 moves along the locus of a 
sine wave, image 12 linearly moves rightward and image ss 
13 moves along the locus of a square. 
[0157] Then, it is assumed that at time t=1 , notification 
of an event is posted and the plot information generating 



unit #1 is requested by the image management unit 11 
of image 11 to be deleted. In this case, the image man- 
agement unit 11 of image 11 performs an event process, 
and the image information generating unit #1 is deleted. 
Therefore, after this, the difference of a vertical vibration 
is not generated, and only the plot information generat- 
ing unit #2 generates differences. 
[0158] Then, between times t=1 and t=2, each image 
continues to move according to a difference generated 
by each plot information generating unit 41 and added 
to the position coordinates, as shown in Fig. 23. At this 
time, image t1 stops vertically vibrating, and at time t=1 , 
it linearly moves rightward while maintaining the y coor- 
dinate value. Image 1 2 linearly moves rightward and im- 
age 13 moves along the locus of a square. 
[0159] If the content of the event notification at time 
t=1 is a request to add a new plot information generating 
unit #3 to the image management unit 11 of image 11 , 
the image management unit 1 1 adds the plot information 
generating unit #3. After this, differences generated by 
three plot information generating units #1 , #2 and #3 are 
added and the position coordinates of image 11 is deter- 
mined. 

[0160] By the way, the dynamic image composition 
apparatuses shown in Figs. 6,11,15 and 1 8 can be con- 
figured using an information processing device (compu- 
ter) shown in Fig. 24. The information processing device 
shown in Fig. 24 comprises a CPU (central processing 
unit) 71, a memory 72, an input device 73, an output 
device 74, an external storage device 75, a medium driv- 
ing device 76 and a network connection device 77, 
which are connected to one another by a bus 78. 
[0161] The memory 72 includes, for example, a ROM 
(read only memory) , RAM (random access memory) , 
etc., and it stores a program and data used for the proc- 
ess. The CPU 71 performs necessary processes by us- 
ing the memory 72 and executing the program. 
[0162] In these examples, the image management 
unit 11 , plotting unit 12, image information function man- 
agement unit 51 , image information string management 
unit 31 , image information generating units 23 and 41 , 
etc., correspond to software components described by 
the program, and each component is stored in the spe- 
cific program code segment of the memory 72. The list 
of pointers 61 , event variable 62, update interval 63, im- 
age data 64, last plot coordinates 65, other plot coordi- 
nates 66, etc., are also stored in the memory 72. 
[0163] The input device 73 includes, for example, a 
keyboard, a pointing device, touch panel, etc., and it is 
used to input a user's instruction and information. Noti- 
fication of an input operation to the input device 73 is 
also sometimes made to the plotting unit 1 2 as an event. 
The output device 74 includes, for example, the VRAM 
13 and display 14 shown in Fig. 5, and it is usedto output 
both inquiries to a user and composed dynamic images. 
[0164] The external storage device 75 includes, for 
example, a magnetic disk device, optical disk device, 
magneto-optical disk device, etc. This external storage 
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device 75 can also store the program and data de- 
scribed above, and the program and data can be used 
by being loaded into the memory 72, if required. The 
external storage device 75 can also be used as a data- 
base for storing the image data 64, plot information f unc- 5 
lion 52, plot information string 32, etc. 
[0165] The medium driving device 76 drives a porta- 
ble storage medium 79 and accesses the recorded con- 
tent. For the portable storage medium, an arbitrary com- 
puter readable storage medium, such as a memory 10 
card, floppy disk, CD-ROM (compact disk read only 
memory), optical disk, magneto-optical disk, etc., is 
used. The program and data described above can also 
be stored in this portable storage medium 79, and can 
also be used by being loaded into the memory 72, if re- 15 
quired. 

[0166] The network connection device 77 communi- 
cates with external devices via an arbitrary network 
(line), such as a LAN (local area network), etc., and 
transmits/receives data accompanying the communica- 20 
tions. The connection network device can also receive 
the program and data from an external device and the 
program and data can be used by being loaded into the 
memory 72. if required. 

[01 67] Fig 25 shows examples of computer readable 25 
storage media which can provide the information 
processing device shown in Fig. 24 with the program 
and data. The program and data stored in the portable 
storage medium 79 or an external database 80 can be 
loaded into the memory 72. The CPU 71 executes nec- 30 
essary processes by using the data and running the pro- 
gram. 

[0168] Although in the preferred embodiments de- 
scribed above, configurations for implementing the im- 
age management unit 11 by software have been de- 35 
scribed, the image management unit 11 can also be im- 
plemented by hardware. 

[01 69] Fig. 26 shows a case where a plurality of image 
management units 11 are configured by one hardware 
circuit. The image management unit shown in Fig. 26 40 
comprises a plurality of memories 81 (#1 -#M), selectors 
82 and 83 for selecting a memory 81 , a plurality of plot 
information generating circuits 84 (#1-#N), selectors 85 
and 86 for selecting a plot information generating circuit 
84 and a control circuit 87. 45 
[01 70] The control circuit 87 switches between the se- 
lectors 82 and 83 by a control signal C1, switches be- 
tween the selectors 85 and 86 by a control signal C2 
and controls the plot information generating circuits 84 
by a control signal C3. In this example, it is assumed for 50 
simplification purposes that only coordinates (x, y) are 
handled as plot information. 

[0171] The memories #1-#M correspond to the image 
management units #1-#M, respectively, described 
above and they store plot information obtained at a pre- 55 
vious time at time t. The plot information generating cir- 
cuits #1-#N correspond to the plot information generat- 
ing units #1-#N, respectively, and are described above 



and perform a calculation corresponding to one move- 
ment element and output the plot information. If the time 
t, an update interval dt and plot coordinates (x, y) at the 
previous time are used as input, outputted plot coordi- 
nates (x 1 , y') are expressed as follows. 

x' = fx(t, dt, x, y) 

y' = fy(t, dt, x, y) (11) 

Above, dt corresponds to the difference between the 
previous time and the present time t, and fx(t, dt, x : y) 
and fy(t, dt, x, y) correspond to functions to generate an 
image movement. For example, if a vertical vibration is 
generated using sin(t), the following equations hold true. 

fx (t, dt, x, y) = x 
fy(t, dt. x, y) = y+sin(t)-sin(t-dt) (12) 

[0172] These functions can also output the history of 
past plot coordinates. For example, input coordinates 
(x_t1 , y_t1) at time t1 can be stored, and a function to 
continue to output the coordinates (x_t1 , y_t1 ) after time 
t1 can be defined. 

[0173] If the same plot information generating circuit 
84 is used for a plurality of images, such plot coordinate 
data are stored in a register of the plot information gen- 
erating circuit 84 for each image, and appropriate data 
are outputted by switching the register by a control sig- 
nal C3 from the control circuit 87. 
[0174] When a plot update process is started at time 
t, first the selectors 82 and 83 are switched over by a 
control signal C1 from the control circuit 87 and a mem- 
ory #1 is selected. Then, the selectors 85 and 86 are 
switched over by a control signal C2 and a plot informa- 
tion generating circuit #1 is selected. Simultaneously, 
the register of the plot information generating circuit #1 
is switched by a control signal C3, if required, and ap- 
propriate data are selected. In this way, the plot coordi- 
nates of the memory #1 are inputted to the plot informa- 
tion generating circuit #1, and the output from the plot 
information generating circuit #1 is stored in the memory 
#1. 

[0175] Then, the selectors 85 and 86 are switched 
over, a plot information generating circuit #2 is selected 
and the plot information is inputted from the memory #1 
to the plot information generating circuit #2. Then, plot 
coordinates are generated in the plot information gen- 
erating circuit #2 in the same way as in the case of the 
plot information generating circuit #1 , and the plot coor- 
dinates are stored in the memory #1 . After such an op- 
eration is repeated for all plot information generating cir- 
cuits 84 assigned to the image management unit #1 , the 
output of the last plot information generating circuit 84 
is outputted as the plot information at the present time 
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of the image management unit #1 . At this time, the plot 
information is simultaneously stored in the memory #1 . 
[0176] After the operation of the image management 
unit #1 is completed in this way, the selectors 82 and 83 
are switched over, the memory #1 is selected and the 5 
operation of the image management unit #2 is per- 
formed in the same way. After such an operation is re- 
peated for M image management units, the plot update 
process at time t is completed. 

[0177] For example, a case is described where the im- 10 
age management unit #1 corresponding to the memory 
#1 generates a rightward shift along the locus of a sine 
wave and the image management unit #2 correspond- 
ing to a memory #2 generates a leftward shift along the 
locus of a sine wave. It is assumed that plot information 15 
generating circuits #1 , #2 and #3 generate the following 
respective movements. 

Plot information generating circuit #1 : Vertical vibra- 
tion of sin(t) 20 
Plot information generating circuit #2: Rightward lin- 
ear shift 

Plot information generating circuit #3: Leftward lin- 
ear shift 

25 

[0178] In this case, the circuit shown in Fig. 26 first 
selects a memory #1 using the selectors 82 and 83, and 
it selects a plot information generating circuit #1 using 
the selectors 85 and 86. In this way, the vertical vibration 
of sin(t) is added to the coordinates of the memory #1 . 30 
Then, the circuit selects a plot information generating 
circuit #2 using the selectors 85 and 86. In this way, a 
rightward shift is added to the plot coordinates of a mem- 
ory #1. and, as a result, plot coordinates in the case 
where the plot coordinates move rightward along the lo- 35 
cus of a sine wave are outputted. 
[01 79] Then , the circuit selects a memory #2 using the 
selectors 82 and 83 and it selects the plot information 
generating circuit #1 using the selectors 85 and 86. In 
this way, the vertical vibration of sin (t) is added to the 40 
plot coordinates of the memory #2. Then , the circuit se- 
lects a plot information generating circuit #3 using the 
selectors 85 and 86. In this way, a leftward shift is added 
to the coordinates of the memory #2, and, as a result, 
plot coordinates in the case where the plot coordinates 45 
move leftward along the locus of a sine wave are out- 
putted. 

[0180] In this way, by switching both the memories 81 
and plot information generating circuits 84 using selec- 
tors, the outputs of a plurality of plot information gener- 50 
ating circuits 84 can be combined and one image move- 
ment can be generated. One plot information generating 
circuit 84 can also be used to generate a plurality of im- 
age movements. 

[0181] As described above, the present invention is 55 
applicable to an arbitrary field, software or hardware, 
where a dynamic image moves as time elapses or ac- 
cording to an event. The following are potential software 



applications. 

(1) Dynamic image generation software 

(2) Home page generation software and browser 
software 

(3) CD-ROM content generation software and re- 
production software 

(4) Presentation generation software and reproduc- 
tion software 

(5) Game generation software and game software 

[01 82] For example, in a conventional multimedia title 
generation/reproduction system used for home page 
generation, etc., only one movement can be given to 
one image element. Therefore, if a vertical vibration with 
a rightward shift is given, the combined result of the two 
movements must be anticipated and prepared in ad- 
vance. 

[0183] However, according to the system of the 
present invention, a vertical vibration with a rightward 
shift can be composed by separately generating a right- 
ward shift and a vertical shift and by linking both to one 
image component when an image is reproduced. If this 
system is adopted, a movement can be dynamically 
added /deleted according to a user's instruction or time. 
[0184] According to this system, since a rightward 
shift and a vertical vibration are separately managed 
when an image is reproduced, a movement in which the 
image starts moving rightward while vertically vibrating 
when the image which is moving rightward is clicked, 
and in which the image stops vertically vibrating when 
the image is clicked again, can be easily generated. In 
this case, the system can be configured in such a way 
that first a rightward shift is linked to an image compo- 
nent as a fundamental movement and a vertical vibra- 
tion is added/deleted by a click event. According to the 
conventional system, a rightward shift and a rightward 
shift with a vertical vibration are separately configured 
and they are switched over by a click. However, if the 
two movements are prepared without concern to the 
continuity, there is a possibility that the two movements 
may be discontinued when they are switched over. 
[0185] If the system of the present invention is adopt- 
ed, a multimedia title producer can handle each move- 
ment as a component. Since each kind of movement 
element is recorded in the completed multimedia title in 
a disassembled state, another producer can extract his/ 
her favorite movement element from the multimedia title 
and can use the element as a movement component. 
[0186] For example, it can be considered that a mul- 
timedia title including an image which moves along a 
specific path while vertically vibrating in a specific fre- 
quency includes two movement components, that is, a 
vertical vibration with a frequency and a shift along a 
path. In this case, the vertical vibration with a frequency 
can be implemented even in another multimedia title by 
extracting and using only the vertical vibration with the 
frequency. However, according to the conventional sys- 
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tern, since a movement is composed in advance when 3 
the multimedia title is produced, it is very difficult to ex- 
tract only the vertical vibration with a frequency. 
[0187] Although in the preferred embodiments de- 
scribed above, for a plot information function, the verti- 5 
cal vibration of a sine wave and a leftward/rig htward lin- 
ear shift are used, another arbitrary function can also be 4 
used. For example, the vibration of a cosine wave, a shift 
along a straight line y=ax+b, a shift along a parabola, a 
shift along a circle/ ellipse and the like can also be de- 10 
fined as a function. A plot information string is not limited 
to the locus of a square, and the locus of an arbitrary 
shape, such as a parabola, circle, ellipse, etc., can also 
be used for a plot information string. 

[0188] Furthermore, plot information generated by a 15 
plot information generating unit is not limited to the plot 
position of an image and it can also be the enlargement/ 
reduction ratio, rotation angle, color, sequential relation- 
ship, etc., of an image component. A more complex dy- 
namic image can be displayed by dynamically combin- 20 5. 
ing these pieces of information. 

Industrial Applicability 

[01 89] According to the present invention , when a plu- 25 
rality of dynamic images are displayed on a screen, a 
complex movement can be easily generated by combin- 
ing a plurality of movement elements. For example, a 
movement can be added/deleted in real time according 
to an event, a movement can be stopped or one move- 30 
ment element can be applied to a plurality of images. 



The dynamic image composition apparatus accord- 
ing to claim 1 , wherein 

said plot information generating means gen- 
erates a difference of plot information between a 
previous time and the present time. 

The dynamic image composition apparatus accord- 
ing to claim 1 , further comprising 

plot information function management means 
(51) for storing one or more plot information 
functions, wherein 

at least one of said plurality of said plot infor- 
mation generating means store identification 
information for referring to a plot information 
function and calculates the plot information us- 
ing the plot information function corresponding 
to the identification information. 

The dynamic image composition apparatus accord- 
ing to claim 1 , further comprising 

plot information string management means 
(31 ) for storing one or more plot information strings 
including discrete plot information, 
wherein 

at least one of said plurality of said plot infor- 
mation generating means store identification infor- 
mation for referring to a plot information string and 
calculates the plot information using the plot infor- 
mation string corresponding to the identification in- 
formation. 



Claims 

1. A dynamic image composition apparatus for com- 
bining and plotting one or more images, comprising: 

a plurality of plot information generating means 
(1 , 23, 41 and 84) for generating plot informa- 
tion used to plot a dynamic image; 
image management means (2 and 1 1 ) for man- 
aging image data of each image and generating 
plot information at a present time of each image 
by combining one or more pieces of information 
generated by one or more of the plurality of the 
plot information generating means; and 
plotting means (3, 12, 13 and 14) forreceiving 
the image data and the plot information at the 
present time from the image management 
means and plotting the image data based on 
the plot information at the present time. 

2. The dynamic image composition apparatus accord- 
ing to claim 1 , wherein 

said plot information generating means gen- 
erates absolute plot information. 
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The dynamic image composition apparatus accord- 
ing to claim 5, wherein 

said at least one of said plurality of said plot 
information generating means calculate the plot in- 
formation by performing interpolation using the dis- 
crete plot information included in the plot informa- 
tion string. 

The dynamic image composition apparatus accord- 
ing to claim 1 , wherein 

said plot information generating means stores 
a parameter for modifying plot information and cal- 
culates the plot information using the parameter. 

The dynamic image composition apparatus accord- 
ing to claim 1 , wherein 

said plot information generating means gen- 
erates as the plot information information about a 
plot position on a screen of an image. 

A dynamic image composition apparatus for com- 
bining and plotting one or more images, comprising: 

image management means (2 and 1 1 ) provided 
for each image, for including a plurality of se- 
quentially ordered plot information generating 
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means (1, 23, 41 and 84) for generating plot 
information used to plot a dynamic image, a first 
plot information generating means updating 
plot information at a previous time and passing 
the plot Information to a subsequent plot infor- 5 
mation generating means, an intermediate plot 
information generating means updating plot in- 
formation provided by a preceding plot informa- 
tion generating means and passing the plot in- 
formation to a subsequent plot information gen- 10 
erating means, and a last plot information gen- 
erating means updating plot information provid- 
ed by a preceding plot information generating 
means and generating plot information at a 
present time; and 15 
plotting means (3, 12, 13 and 14) for receiving 
the plot information at the present time from the 
image management means and plotting a cor- 
responding image based on the plot informa- 
tion at the present time. 20 



10. The dynamic image composition apparatus accord- 
ing to claim 9, wherein 

each plot information generating means gen- 
erates a difference of plot information between the 25 
previous time and the present time, adds the differ- 
ence to inputted plot information and updates the 
inputted plot information. 

11. A dynamic image composition apparatus for com- 30 
bining and plotting one ormore images, comprising: 



12. A dynamic image composition apparatus for com- 
bining and plotting one ormore images, comprising: 50 



information about a plot position at a present 
time of each image by combining one or more 
pieces of information generated by one or more 
of the plurality of the plot information generating 
means; and 

plotting means (3, 12, 13 and 14) for receiving 
the image data and the information about the 
plot position at the present time from the image 
management means and plotting image data 
based on the information about the plot position 
at the present time. 

13. A computer-readable storage medium (72, 75, 79 
and 80) on which is recorded a program for enabling 
a computer to execute a process, the process com- 
prising: 

generating a plurality of pieces of plot informa- 
tion used to plot an image, for each image; 
generating plot information at a present time of 
each image by combining the plurality of pieces 
of plot information ; and 
plotting each image based on the plot informa- 
tion at the present time. 

14. A computer-readable storage medium (72, 75, 79 
and 80) on which is recorded a program for enabling 
a computer to execute a process, the process com- 
prising: 

generating plot information at a present time by 
updating plot information used to plot an image 
at a previous time for each image by a plurality 
of sequentially ordered plot information gener- 
ating processes; and 

plotting each image based on the plot informa- 
tion at the present time. 

15. A computer-readable storage medium (72, 75, 79 
and 80) on which is recorded a program for enabling 
a computer to execute a process, the process com- 
prising: 

generating differences of a plurality of pieces of 
plot information used to plot an image between 
a previous time and a present time, for each 
image; 

generating plot information at the present time 
of each image using a sum of the differences 
of the plurality of the pieces of the plot informa- 
tion; and 

plotting each image based on the plot informa- 
tion at the present time. 

16. A dynamic image composition method for combin- 
ing and plotting one or more images, comprising: 

generating a plurality of pieces of plot informa- 



a plurality of plot information generating means 
(1, 23, 41 and 84) for generating information 
about a plot position in correspondence with a 
movement element which generates a move- 55 
ment of a dynamic image on a screen; 
image management means (2 and 1 1 ) for man- 
aging image data of each image and generates 



image management means (2 and 1 1 ) provided 
for each image, for including a plurality of plot 
information generating means (1 and 41) for 35 
generating a difference of plot information used 
to plot a dynamic image between a previous 
time and a present time and means (22, 42 and 
43) for generating plot information at the 
present time using a sum of differences gener- *o 
ated by the plurality of the plot information gen- 
erating means; and 

plotting means (3, 12, 13 and 14) for receiving 
the plot information at the present time from the 
image management means and plotting a cor- 45 
responding image based on the plot informa- 
tion at the present time. 
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tion used to plot an image, for each image; 
generating plot information at a present time of 
each image by combining the plurality of pieces 
of plot information; and 

plotting each image based on the plot informa- 
tion at a present time. 
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